Method 1 - Babbitt Score 



(1100) For a given variable, for att 
observations, convert provided values 
into proxy values, if necessary. 



(1200) For a given variable, for ail 
observations, segregate proxy values 

associated with the variable into 
categories (e.g., Top 2 box, Top 3 box, 
etc.) 



1 




(1300) For each category, determine 
values' distribution by dividing number 
of provided values in category by total 
number of provided values 


1 





(1400) Calculate a top category score 
by adding the top category distribution 
(%) to the bottom category distribution 
(%) and subtracting an ideal 
distribution of neutrals (%) and 
multiplying an absolute value of the 
result by 100 



(1500) Calculate a difference score by 
subtracting the bottom category 

distribution (%) from the top category 
distribution (%) and multiplying an 
absolute value of the result by 100 



± 

(1600) Calculate an effectiveness 
(Babbitt) score for the variable by 
adding the top category score to the 
difference score 



^ I 

(1700) Evaluate the variable based on 
the effectiveness score 
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Method 2 - Bestfit Clustering 



(2100) For each observation, obtain dataset, 
each dataset having observation IDs, variables, 
possible values, provided values, and (where 
applicable) proxy values for provided values 



(2200) Speafy a number of clusters, 
any desired variable weights, and a 
maximum number of Iterations for the 
clustenng sdutjon 



I The # of clusters is an integer > 0. 
1 The # of iterations is an integer > 0. 



(2300) Develop initial duster 
assignments: Select only 1 path within 
(2130) 



(2350) Read specified initial duster 
assignments (already present in 
dataset, of. Method 3) 



Throughout Method 2, variable 
weights (where applicable) are 
incoroporated within fitness score 
calculation (cf. Method 10) 



(2360) Systematic Search: Identify 
the pair of variables that creates a 
clustering solution that maximizes 
fitness score using the spedfied 
number of dusters 



(2370) Thorough Search: Identify any 
two variables that together create a 
clustering solution that maximizes 
fitness score using the spedfied 
number of dusters 



(2361) Discover the 1 variable that 
creates a dustering solution that 
maximizes fitness score using the 
spedfied # of dusters 



(2371) Discover the 1 variable that 
creates a dustenng solution that 
maximizes fitness score using the 
spedfied # of dusters 



(2362) Hold the variable from (2361) 
constant and discover the variable that 
in tandem creates a dustenng solution 
that maximizes fitness score using the 
spedfied # of dusters 



(2372) Hold variable from (2371) or 
(2373) constant and discover the 
variable that in tandem creates a 
dustenng solution that maximizes 

fitness score using the spedfied # of 
dusters 



(2373) Hold variable from (2372) 
constant and find the variable that in 
tandem creates a dustering solution 
that maximizes fitness score 



(2400) Store observation IDs, corresponding 
duster IDs, fitness score 



Repeat this process by 

cyding through all 
possible combinations 
of variable pairings until 

fitness score as 
calculated In (2373) is 
maximized 
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Method 2 - Bestfit Clustering - Continued 




From Ftg. 2a 



FROM (2400) 



(2450) For each cluster and variable, 
calculate the mode of provided values, 
and (where applicable) proxy values 
for provided values 



(2460) Store cluster IDs, vanable IDs, 
and corresponding modes from (2450) 



i From (2591) 



I 



(2470) Select a fraction of 
observations, divided evenly among alt 
specified clusters from the dataset 



(2480) Randomly re-assign the 
observations from (2470) to different 
clusters 



It is preferrable that 
observations be chosen 
randomly; furthermore it is 
preferrable that the exact 
fraction never exceed 10% of 
the entre dataseVs population 
of observations 



(2490) For each cluster and variable, 

calculate the mode of provided 
values, and (where applicable) proxy 
values for provided values 



(2500) Calculate fitness score for the 
clustering solution developed in (2480) 



(2505) Store fitness score, cluster 
assignments, and observation IDs 



From (2550) 



(2510) Select one random observation 
from a random cluster and change its 
cluster assignment 



(2520) C^alculate fitness score of 
(2510) 



(2530) Conditional function: Compare 
fitness score of (2520) with (2505) 



Only proceed if looping 
from (2550) 



(2531) If fitness score of (2520) 
< or = fitness score of (2505). 
cycle through ail possible duster assignments 
for observation selected in (2510) until fitness 
IS maximized 



(2536) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



(2532) Conditional function: (Compare 
maximum fitness scc^e of (2531 ) wth (2505) 



(2533) If fitness score of (2520) 
<or= (2505), return selected 
observation to original cluster 
assignment 



(2535) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



(2534) Return to 
(2510) 



Hold the otiier observations in 
their current cluster 
assignments from (2505) 



(2551) If fitness score of 
(2520) - (2505), 
proceed to (2560) 



(2552) if fitness score of 
(2520) < or > (2505), 
return to (2540) 



(2540) Store 
Observation IDs 
and new cluster 
assignments 
$ 



(2550) Replace 
(2505) with (2540) 
and return to (2510) 
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Method 2 - Bestfit Clustering - Continued 




FROM (2551) 



To (2470) 



(2560) End Iteration 



i steps (2510) I 
j through (2560) | 
i represent 1 Iteration i 



(2570) Store Iteration ID, 
Observation IDs, corresponding 
duster assignments 



Iteration ID is a positive integer <= the 
total # of specified iterations. Its value 

increases serially in the fomi 
x + 1 where x = previous Iteration ID. 



(2580) Conditional function: 
compare Iteration ID from 
(2570) vvith total # of iterations 
specified in (2200) 



(2581) If Iteration 
ID from (2580) < 
total # of iterations 
specified in (2200), 
return to (2470) 



(2582) If iteration 
ID from (2580) = 
total # of iterations 
specified in (2200), 
proceed to (2600) 



(2600) Store Iteration ID that produced maximum 
fitness score, maximum fitness score, observation 
IDs, and corresponding cluster assignments that 
produced maximum fitness score 



(2610) Dump data from (2600) 
into a file of usable format (e.g. 
ASCII, .CSV, .bet, .pm) 



(2620) Terminate 
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Method 3 - Champion/Challenger 
Clustering Refinement 



(3010) For each obsei^ation, obtain dataset, 
dataset having variables, possible values, 
provided values, and (where applicable) 
proxy values for provided values 




r 


(3020) Append initial cluster assignments 
to dataset (so they correspond to 
Observation IDs) 






(3030) Specify maximum number of 
iterations 






(3040) Execute (2450) to (2610) of 
Method 2 




r 


(3050) Terminate 



Method 4 - Composition Analysis 



(4010) For each observation, obtain dataset 
having a cluster assignment for the 
observation and having a proxy value for 
each of the vanabies in the dataset, each 
variable having possible values 



<4Q20) For each observation, estmate a 
purposeful probability (a measure of a 
proabllity that an observation in a particular 
duster provides an answer to a question In 
a non-random manner) that a particular 
possible value for a particular vanable will 
be provided by observations assigned to a 
particular cluster 



(4021) Create probability variables 
for each cluster, variable, answer 
combinations as 



(4022) Estimate the probability that answer 
valued is given by the observations in 
duster w for a variable k that has 
possible answers 



(4023) Define 6 within a constraint that 
allows for usable output 



(4025) For each observation, 
store and/or output the 
purposeful probabiiity 



(4024) Computational process 


s executed 


across all 




Nm 


•Lk)+d 



(4030) For each observation and 
each possible value, calculate a 
serendipity probability (a measure 
of a probability that an observation 
in a particular duster will be 
assodated with any of the 
possible values for a particular 
variable) 



If a observation / in duster m 
selected responses 
"randomly," then the 

probabilities of selecting his 
responses should be 
descritied as 

JL 
L 



(4050) For each observation, assume that 
before observation made, observation has 
an equal probability of being in any duster 



(4055) For each observation, assume that 
the purposeful probabilities are true 



(4060) For each observation calculate a Bayes 
probability that a particular observation can be 
in each duster conditional upon the 
observation's proxy value 



(4065) For each 
observation, store and/or 
output the Bayes probability 



(4035) For each observation, 
calculate a ratio of purposeful 
pnjbability to serendipity probability 



(4040) For each observation, calculate a log of 
the ratio to obtain a composition analysis score 



(4045) For each observation, store and/or 
output the composition analysis score 



If ^ = 0, the resulting 
over-predsion of the 

calculated probabilities 
compromises 

computational effidency 



is a value that produces 
meaningful results 



Let = total # of observations in 
cluster m; Njk, = the # of 
observations in duster m who give the 
jS-ih answer value to vanable k; and 



S - mm 



If observation i in duster m 
"purposefully" and "logically" 
selected his responses, then the 

probabilities of selecting his 
responses should be described by 



Calculate 

NB: n means calculate P for each 
/lt,.„.^y where i^ = ^; 

£ retains its 
customary function 



(4080) For each observation, calculate a 
percent of proxy values for the variables 
that equals a mode of that observation's 
duster's proxy values for the 
corresponding variables 



(4085) For each 
observation, output 
the calculated 
percent 



(4090) Classify each observation based on results obtained in 
activity (4045). (4065). and/or (4085) 
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Method 5 - Segmentation-on-the-Fly 



(5100) Obtain dataset for observations, 
dataset having variables, possible 

values, provided values, and 
corresponding cluster assignments 



For this flow chart, let the total set 
of variables be defined as {K) and 
the desired maximum # of 
variables to fc>e used as ^^^j 



(5200) Conditional function: Determine if 
cluster weights are needed to meet 
coverage or efficiency objectives 



Underweighting is used to implement 
efficiency, while overweighting is used to | 
implement coverage 



(5210) If no weights are 
needed, proceed to (5300) 



(5220) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(5221). (5222). (5223) 



All dusters must be 
assigned weights, 
regardless of magnitude 



(5221) If cluster is to be 
unweighted, set weight 
as *v = 1 



(5222) If duster is to be 
overweighted, set weight 
as w > 1 



(5223) If cluster is to be 
underweighted, set 
weight as 0 < w < 1 



(5300) Begin approximating the clustering solution 
developed using Method 2 by developing clustering 
solutions that employ only 1 variable 
from {Kj In each. 



(5310) Create a "dummy" variable for each 
cluster so that if there are M clusters, then 
M variables 



(5320) Conditional function: populate variables 
per observation per clustering solution 



j In other words, if there are K variables, then K 
optimized solutions are created, 1 per A in {K} 



Let designate a 
"dummy" variable for 
observation / in cluster n 



Let i be a memt>er of the set of 
obsenrations (RJ.kbea member of 
the set of variables {KJ, and m be a 

memt>er of a set of clusters (Mj 



1 



(5321) If observation i is in 
cluster m, then Y = 1 



i 



(5322) If observation i is 
not in cluster m, then Y^^ - 0 



1 






(5330) Store all values for M 
variables for alt observations 
for each clustering solution 
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Method 5 - Segmentation-on-the-Fly - Continued 




(5340) Create a "dummy"* vanabie tor every 
variabie-possibte value combination so that 
if there are possible answers to variable 
k, then z.^ "dummy" variables are created 
for each observation t for each clustering 
solution 



So the total number of variables 
created per observation per 
cluster is K(Lf) 



(5350) Conditional function: for observation i 
and variable k, populate variables per 
clustenng solution 



(5351) If observation t 
gives the ^-th answer for 
variable k, then X^^^~ 1 



(5352) If observation / 
does not give the £ -th 
answer for variable k, 



Let XiSi designate a 
"dummy" variable for 
observation i who can 
answer possible value £ or 
variable k 



(5360) Store ail values for K(Li^ variables 
for all observations per clustering solution 



(5370) For each duster in (M), use ordinary 

least squares to regress all for all 
observations in {R} per clustenng solution 



Index is created by 
multiplying the linear 
approximation to the 

probability of an 
observation's cluster 
assignment by that 
duster's spedfied weight 



Regression occurs on: 



SO that we can generate a linear approximation to the 
probability that an observation with a particular set of 
answers to the variables in (K) is in a particular duster 
within {M} 



(5380) Conditional function: construct a "simpler" 
dustenng solution to the one generated using 
Method 2 (Bestfit dustenng) 



(5381) If weights were spedfied 
in (5200), create an index for 
each observation's duster 
assodation 



By "simpler", what is meant is an 
approximation of the "actual" 
dustenng solution using the 
spedfied constraints, in this case 
using only 1 variable within {Kj 



(5382) If weights were not spedfied in (5200), assign 
each observation in (R} to the m-th duster in {Mj that 
gives the highest value of the linear approximation to 
the probabilities of being in any of the members of {MJ 
as calculated in (5370) for each dustering solution 



(5383) Assign each observation in (R) to the 
m-th cluster in (Mj that gives the highest 
index value for each dustenng solution 



(5390) Store the outputs of regression (i.e. coeffidents and 
constants), variable IDs, observation IDs, "approximated" duster 
assignments, and actual duster assignments for all dustering 
. solutions 
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Method 5 - Segmentation-on-the-Fly - Continued 




FROM (5390) 



(5400) Calculate accuracy 
scores for the results 
stored In (5390) for alt 
clustering solutions 



Accuracy score = 
[# of observations whose 
approximated and actual 
cluster assignments are 
identical} divided by [the total 
# of observations in {R} ] 



(5410) Select the stored 
solution from (5390) that 
maximizes accuracy score 



(5411) Store the outputs of regression (Le. coefficients and constants), 
variable IDs, observation IDs, "approximated" duster assignments, and 
actual cluster assignments for the solution that was selected in (5410) 



(5420) Begin approximating clustering 
solutions using only 2 variables in each 



(5421) Hold variable* from 
(541 1 ) constant and now 
execute (5310) through (5400) 
for all possible pairs of k from 
(5411) and the 
(/: + ^)-th variable 



(5422) Refine winning 2 variable solution 
from (5421) 



The pattern in 
(5423) increases 
serially as the 
number of variables 
used to approximate 
the clustering 
solution from 
Method 2 increase 
serially 



(5423) Hold the 
{k + ^yth variable from (5421) constant and now 
execute (531 0) through (541 1 ) for ail possible pairs 

of the {k + ^yth variable from (5421) and the 
remaining variables in {K}, excluding the (A + 1)-//r 
variable and variable k identified in (5411) 



(5430) Continue looping (5420) through (5423) by sequentially 
increasing the number of variables used in (5420) at the beginning of 
each loop until a maximized solution (in tenns of accuracy score) is 
identified for a simpler clustering solution that uses k variables to 
approximate the clustering solution identified inUlethod 2 



(5440) Select and store the outputs of regression, variable IDs, "approximated" cluster 

assignments (and corresponding observation IDs), actual cluster assignments (and 
corresponding observation IDs), and accuracy scores for only the maximized solutions 
for all solutions created up through and including k variables 



Therefore if the (jt -t- 2)'th 
variable Is added to the pair 
of the k'th and (k + D-th 
variables to create a 
clustering solution that best 
approximates the objective 
function (i.e. original 
clustering structure 
developed in Method 2). then 
in the refining process 

(5422), the 
(k + 2)-th variable is held 
constant while the k-ih ar«J (k 

+ ])-th variables are 
replaced with all remaining 
variables to test the triplet of 

variables that best 
approximates tiie results of 
Method 2 



(5450) Dump (5440) into a file with usable data format 
(e.g. ASCII, .txt, .csv, .pm) 



(5460) Temiinate 
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Method 6 - Behavioral Segment Scoring 



(6100) For each observation, obtain 
dataset, each dataset having variables, 
possible values, provided values, and 
corresponding cluster assignments 
(developed in Method 2) 



1 




(6200) Transfonn all continuous variables 
into categorical or scalar forms 






(6300) Conditional function: Refine 
dataset to facilitate analysis 



{ Dataset can consist of 
J any combination of 
"1 scalar, categorical, and 

I continuous variables 



Analyze distribution boundanes within a 
series of ranges to find the boundaries that 
create as normal distributions as possible; 

linear optimization is the most efficient 
method for executing this 



1 








(6310) If dataset 

has <= 100 
variables, proceed 
to (6400) 




(6320) if dataset 

has > 100 
variables, reduce 
dataset as much 
as possible 



(6321) Execute the following 
analyses: 

- log scores 

- tree analysis 

- regression 

- discriminant analysis 



(6322) Remove variables 
identified in any 3 of 4 of the 
techniques in (6321) as "non- 
oontributorsTinsignificant" 



These are standard 
statistical techniques that 
can be done in a 
mathematical 
prc)grammtng language 

like Fortran or Stat 
software package like 
SPSSorSAS 



Although <= 100 variables 

is idea! (in tem>s of 
computational efficiency), 
do not force an arbitrary 
"cut-ofT to ensure < =100 
variables are used in 
the dataset 




Fig. 6a 



Method 6 - Behavioral Segment Scoring - Continued 



FROM (6310) or (6322) 



(6400) Conditional function: Specify 
maximum # of behavioral variables to be 
used in solution set depending on 
computational and/or time constraints 



(6410) If there is a 
computational or time 

constraint, select a 
maximum # of behavioral 
variables to be used < 

total # of behavioral 
variables In the dataset 



(6420) If there is no 
computational or time 
constraint make 
maximum # of behavioral 
variables to be used = 
total # of behavioral 
variables in the dataset 



1 




(6500) Conditional fi 
cluster weights ar 
marketing coven 
efficiency 


jnction: Detemriine if 
e needed to meet 
age or mari<eting 
objectives 



(6510) If no weights are 
needed, proceed to (6600) 



(6520) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(6520), (6522), (6523) 



(6521) If duster is to be 
unweighted, set weight 
as>i' = 1 



All dusters must be 
assigned weights, 
regardless of magnitude 



(6522) If duster is to be 
ovenweighted, set weight 
aSM'> 1 



(6523) If duster is to be 
underweighted, set 
weight as 0 < w < 1 



(6800) Execute steps 

(5300) to 
(5450) (of Method 5) 



(6700) Terminate 
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Method 7 - Panel Analysis 



(71 00) Conditional function; Ascertain 
use of panel data 



<7110) If use panel data as 
objective measures of 
behaviors to input into 
clustering executed using 
Method 2, follow this path 



(7111) Refine data 
collection instrument (e.g. 
survey) using Invention I 

(i.e. Babbitt Score) 



(7120) If use panel data for 
post-clustering analyses 
(e.g. tracking, promotion, 

positioning) follow this path 



1 


r 


(7121)Condit 
Data cc 


onal function: 
rtiection 



These 2 paths are not 
exclusive, but cannot be 
executed simultaneously. 
However, path (7110) can 

feed into path (7121). 



This is needed to ensure 
that the clustering solution 
developed using this 

dataset is truiy 
representative of a 
maricelTindustry and just 

the function of an 
idiosyncratic group of the 
overall population 



Anal^ distribution 
boundaries within a series of 
ranges to find the 
boundaries that create as 
normal distributions as 
possible; linear optimization 
is tiie most efficient method 

„_„J[Qt.^?^^i}S.??l§- 



(7112) Field data collection 
instrument witiiln panel (e.g. 
IRt, Nielsen, Simmons, 
comSCORE, MRI) 



(7113) Extract observations 
from coUected data to 
assemble a dataset thai 
reflects a category's/ 
industry's underiying 
demographics 



(71 14) Obtain dataset for 
extracted observations, 
dataset having variables, 
possible values, and 
provided values 



(7115) Append panel-based 
behavioral variables to each 
corresponding observation 
in dataset 



(7116) Transform any panel 
variabies that are 

continuous into categorical 
or scatar variables 



(7117) Input data set from 
(7116) into (2420) of BestFit 
Clustering and proceed witin 
clustering 



(7121,1) If dataset 
developed using 
path (7110), proceed 
to (7122.1) 



(7121 .2) Refine data 
collection instrument (e.g. 
survey) using Babbitt Score 



(7122) Execute 
Metiiods 2 
through 4 



(7123) Execute 
Methods 2 
through 5 



(7123.1) Use typing tool developed in (7123) 
to cluster score a representative sample of the 
panel's memt>ers using an expedient contact 
channel (e.g. outbound telephone, e-mail/ 
electronic surveys, mail-based surveys 



(7124) Execute cluster-level 
analyses using panel data 



(7125) Terminate 



i 

(7118) Terminate 
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Method 8 - Overall Segment-Based Marketing Process 



(8100) Develop and Field 
Pilot Survey 



(8200) Refine Survey 



Babbitt Score 
Bestfit Clustering 



(8300) Field Full 
Enumeration Survey 



Append pane! variables and/or other 
respondent-lvel behaviours (if applicable) 



If applicable 



(8850) Panel Analysis 



(8900) Develop Segment 
Insights 



(8950) Develop and Execute 
Marketing Ideas 



(8400) Clean Data 



(8500) Create Clusters 



(8600) Refine Clusters 



(8800) Append Panel 
Variables 



Composition Analysis 



Babbitt Score 

Champion/Challenger Cluster Refinement 
Panel Analysis 



Composition Analysis 



(8700) Segment-on-the-Fly 



(8750) Behavioral Segment 
Scoring 
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Information Device 9 



— p, 


(9500) I/O 








(9400) Instructions 


— ► 


(9300) Mennory 






— ^ 


(9200) Processor 






— ► 


(9100) Network 
Interface 



Method 10 - Fitness Score Calculation 



(10010) Calculate modes of given values for ali 
variables in {K} for duster n 



(10020) Store modes, con-esponding 
variable IDs, corresponding cluster ID 



Where nG{iV}e{/} 

N consists of a finite # of dusters > 0. 
/ = domain of integers 



(10030) Calculate modes of given values for all variables 
In for duster n+>' 



(10040) Store modes, conresponding 
variable IDs, corresponding duster ID 



(10050) Conditional function: Assess 
the number of dusters for which 
modes have been calculated 



(10060) If the number of 
dusters for which modes 
have been calculated = 
proceed to (10080) 



(10070) If the number of 
dusters for which modes 
have been calculated < N, 
return to (10030) 



Where kG{K]e{l} 

K consists of a finite # of 

variables >0. 
/ = domain of integers 



Where 



^ e 



(10080) For each duster, compare the 
value provided by each constituent 
member for variable k to the cluster's 
mode for variable k 



R consists of the set of observations, 
whose total number of 

constituents is > 0. 
/.r.domain^qfjntege^^^ 



(10090) Conditional function: compare 
value of (■ for k to the mode of k 



i Where i„ is a member of duster n 



(10100) if equal, set 



(10110) if not equal, 
setK =0 



is the variable k as answered by 
duster n 



(10120) Store score V. 



\ Where = score for observation i 
' " j who Is in duster n and has provided 
\ answer value V for variable k 



(10130) Conditional function: adjust 
V^^ by indicated weight 



(10140) If weight was 
specfied, multiply V^^ 
by corresponding 
weight for k 



(10150) If weight was 
not specfied, multiply 



(10160) Store J^^^from (10140) or 
(10150) 



(10170) Repeat (10080) to (10160) until a 
scx)re V is calculated for all observations in 
their respective dusters for all variables k 



(10200) Sum at) scores K for all 
observations across all variables 



(10300) Store fitness score 



(10400) Terminate 



This is the fitness score 



Fig. 10 



